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Abstract 

We consider an extension of Discrete Time Markov Chain queueing 
model to the quantum domain by use of Discrete Time Quantum Markov 
Chain. We introduce methods for numerical analysis of such models. 
Using this tools we show that quantum model behaves fundamentally 
differently from the classical one. 

1 Introduction 

Today the most important application field for queuing theory is telecommu- 
nication. Queuing theory applied to description of packet switching in net- 
work routers allows to foresee packets behaviour and determine the distribution 
of waiting time for transmission and probability of loosing packets caused by 
buffers overflows. This allows to anticipate the quality of telecommunication 
services. As variability of flows is an important factor of delays and losses, 
it is difficult to obtain exact analytical solutions for wide spectrum of mod- 
els. Markov chains is typical method applied to analysis of transitient states of 
queuing systems. 

In this paper we introduce a new approach to queuing networks based on 
quantum information theory. We consider simple models of queuing systems 
described by Discrete Time Quantum Markov Chains (DTQMC) which are re- 
ducible to Discrete Time Markov Chains (DTMC) . Our model is an adaptation 
of quantum random walks (QRW) where both walker and the system are de- 
scribed by quantum channels. It will be shown that quantum queueing systems 
behave differently than classical ones. 

Discrete Time Quantum Markov Chains are a tool which is used in the the- 
ory of quantum information for example to model noisy behaviour in quantum 
iterative algorithms [5]. 

We want this paper to be self-consistent therefore in Section [2] we recall 
essential basic notions from quantum information theory. The rest of the paper 



is organised as follows, in Section[3]we introduce the model of a quantum queue, 
in Section[4lwe gather the mathematical tool essential for analysis of DTQMCs, 
in Section [5] we discuss the problem of steady state distribution for quantum 
queue, in Section [6] we show that our model reduces to classical one under some 
constraints, in Section [7] we analyse quantum queues initialized with random 
initial states, and in Section [8] we draw final conclusions. 

2 Formalism of quantum information 

2.1 Dirac notation 

Throughout this paper we use Dirac notation. Symbol \ip) denotes a complex 
column vector, (tp\ denotes the row vector dual to The scalar product 

of vectors \if)), \<j)) is denoted by (ip\(f))- The outer product of these vectors 
is denoted as \(j>)(ip\- Vectors are labelled in the natural way: |0) := (1,0) T , 
|1) := (0, 1) T . Notation like |</>^) denotes the tensor product of vectors and is 
equivalent to \4>) <g> \tp). 

2.2 Density operators 

The most general state of a quantum system is described by a density operator. 
In quantum mechanics a density operator p is defined as hermitian (p = p>), 
positive semi-definite (p > 0), trace one (tr(p) = 1) operator. When a basis 
is fixed the density operator can be written in the form of a matrix. Diagonal 
density matrices can be identified with probability distributions, therefore this 
formalism is a natural extension of probability theory. 

Density operators are usually called quantum states. The set of quantum 
states is convex _2J and its boundary consists of pure states which in matrix 
terms are rank one projectors. Convex combinations of pure states lie inside 
the set and are called mixed states. 

2.2.1 Entanglement 

Entanglement is one of the most important phenomena in quantum information 
theory. We say that state p is separable iff it can be written in the following 
form 

M 

P = ^HPi®P?, (i) 
1=1 

where > and YlfLi 1i = 1- A state that is not separable is called entangled. 

2.2.2 Subsystems 

Given two states p A , p B of two systems A and B, the product state p AB of the 

composed system is obtained by taking the Kronecker product of the states i.e. 
p AB _ p A p B 

Let [p AB ]ki be a matrix representing a quantum system composed of two 
subsystems of dimensions M and N. We want to index the matrix elements 
of p using two double indices \p AB ]m^ so that Latin indices correspond to the 

nu 

system A and Greek indices correspond to the system B. The relation between 
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indices is as follows k — (to — 1)M + fi, I = (n— 1)N + v. The partial trace with 
respect to system B reads p A := tvB{p AB ) = an d the partial trace 

with respect to system A reads p B :— trA{p AB ) = J2 m P m v- 

7711/ 

Given the state of the composed system p AB the state of subsystems can by 
found by the means of taking partial trace of p AB with respect to one of the 
subsystems. It should noted that tracing-out is not a reversible operation, so in 
a general case 

p AB ^tr A (p AB )®tr B (p AB ). (2) 



2.3 Completely positive trace-preserving maps (CPTP) 

We say that an operation is physical if it transforms density operators into 
density operators. Additionally we assume that physical operations are linear. 
Therefore an operation $(•) to be physical has to fulfil the following set of 
conditions: 



1. For any positive operator p its image under operation $ has to have its 
trace and positivity preserved i.e. if p > then $(p) > and tr($(p)) = 
trp. 

2. Operator $ has to be linear: 



'YjPipi j = [pi) . 

\ i / i 



3. The extension of the operator $ to any larger dimension that acts trivially 
on the extended system has to preserve positivity. This feature is called 
complete positivity. Extended channel ($ £g) Ik) acting on operators on 
T~Lm ® T~t-K is defined for the product states as 

($ ® t K ) (p ® f) = $ (p) fg) £ (4) 

and extended for all states by linearity. Thus, the complete positivity 
means, that for a positive operator a acting on H,^ ® 'Hki w e have 

($®ljr)(o-)>0. (5) 



CPTP maps are often called quantum channels [21 31 [8] . 

Any operator $ that is completely positive and trace preserving can be 
expressed in so called Kraus form [2], which consists of the finite set {E^} of 
Kraus operators - matrices that fulfil the completeness relation: J2k Ek Ek = 1- 
The image of state p under the map $ is given by 

$(p)=Y / EkpE k l (6) 

k 



2.4 Quantum measurement 

The most general approach to the quantum measurement is given by Positive 
Operator Valued Measures (POVM) [5J. Any partition of identity operator into 
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a set of N positive operators F = {Fi}fL x such that 

N 

E^ = 1 ( 7 ) 

i 

and set of real measurement outcomes O — {oi}^ =1 together with a mapping 
[i : O — > F is called POVM measurement. The probability pi associated with 
any possible measurement outcome o; is given by pi = tr (Fip), where /i(oi) = Fi. 



3 Quantum queue 

The model of a quantum queue presented in this work is loosely based on models 
of discrete time quantum random walks (QRW). Discrete time quantum random 
walks are usually realized by two coupled quantum systems: quantum coin and 
walker. The evolution of this kinds of systems is governed by application of a 
unitary operator on the coin subsystem with application of conditional operation 
on the both systems such that only the state of the coin influences the state of 
the walker. For a elementary introduction to the subject of QRW please refer 
to [6]. 

In our terms we split the coin into two quantum coins which represent the 
flow of jobs into and out of the queueing system. The walker represents the 
length of the queue. We assume that capacity of the queue is finite and number 
of jobs in the queue cannot drop below zero therefore our model might be 
compare to QRW with barriers pQ. 

A quantum queue is modelled in the following way. We chose a quantum 
system consisting of three subsystems which we will identify with input /, output 
O and queue Q. We will apply repetitively CPTP maps on our quantum systems 
effectively forming discrete time quantum Markov chain and measure the state 
of subsystem Q. 



3.1 Transition 

Flow of jobs into the queue, flow of the processed jobs filling and emptying of the 
queue are described by quantum channels. We define two quantum channels: 
<&C that represents the input and output coins and <f>x that represents the 
conditional change of the queueing system state. Schematic depiction in form 
of the quantum circuit of the system is presented in Fig. [I] 
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Figure 1: Schematic representation quantum queue transition. 
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3.2 Queue action 



Let Di,Do are the dimensions of registers for jobs that flow into system in a 
single time step, the jobs processed in a single time step, respectively and Dq 
be dimension of the register representing queue length. 

We define set of Kraus operators that model the protocol governing the 
action of the quantum queue 

Di-\ Do-l Dq-Di 

K s = ^ Y Y \n){n\®\m){m\®\j + n-m){j\, (8) 

n=0 m=0 j=D -l 
Dr-1 Do-l 

K U = Y Y \ n )( n \ ® \ m )( m \ ® |max(/j +n - m,0))(k\, (9) 

n=0 m=0 
Do-l 

Ku * = Y Y ® \m)(m\ ® | min(iij + n - m,D Q - l))(u.;|,(10) 

n— m— 

where Z; e L = {0, 1, . . . , D - 2} and Ui e 17 = {£>q - £> 7 + 1, Dq - £>/ + 
2, . . . , Dq — 1}. Set of Kraus operators K^ s j ULuU forms quantum channel $x . 
In order to better understand the meaning of the above Kraus operators we can 
divide them into three regimes: 

• K s defines evolution of the system in case when the flow of jobs can-not 
cause that state of the queue reaches any of the boundaries. The number of 
jobs waiting in the queue changes by the number of the difference between 
number of jobs flown into and flown out of the queueing system. 

• Operators K\ i define the behaviour of the queueing system in case when 
flow of jobs may cause reaching of the lower barrier. We can say that they 
"protect" the model from reaching the state of negative number of jobs 
waiting in the queue. 

• Operators K Ui define similar behaviour but for the upper barrier. 
3.2.1 Flow of jobs — coins 

In analogy to quantum random walks we introduce coin operator that defines 
the flow of jobs into and from the system. 

Coin can be chosen as any quantum channel acting solely on the composite 
system p 1 ' . One may consider using unitary operators as coins, which is pop- 
ular approach in the field of quantum random walks. It should be noted that 
coins may form a separable quantum channel on systems I and O or they can 
act on compositions of subsystems I and O. To be more precise we define a coin 
as any CPTP map in the form 

i 

where {C-' }^ is any set of Kraus operators. 
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3.2.2 Updating of the queue state 

In order to evaluate a single step of queuing system one have to compose maps 
®K into $ = $x o <£> c . 
The evaluation of the system is based on the application of the map $ to 
a chosen initial quantum state po, so we form DTQMC. After t time steps the 
state of the queue becomes 

p t = po$o o^ po). (12) 
t 

Probability that the queue is of length i at time t is given by 

PtH) = (i\p?\i), (13) 
where pf — tr io{pt) is reduced density matrix. 

4 Tools for analysing quantum queues 

In this section we gather facts from quantum information theory and theory 
of discrete linear dynamical systems which are useful to analysis of quantum 
queues. 

4.1 Super-operator 

Kraus representation of quantum channels is sometimes inconvenient to work 
with. Quantum channel is a linear map therefore it can be represented in form 
of the matrix, which often is called the superoperator. For given set of Kraus 
operators {Ei} corresponding superoperator $ is given by the following relation 

N 

^ = Y^E l ®E* 1 (14) 

i 

where (■)* denotes element-wise complex conjugation. It should be noted that 
spectral properties of $ are important for the analysis of DTQMC. 

4.2 Initial conditions — random states drawn from HS dis- 
tribution 

For initial states in our analysis of quantum queues we take random density 
matrices. The theory of random density matrices is a current subject of a 
much study [21 HI E] ■ In the case of random pure states there exists a natural 
probability distribution, induced by the Haar measure on the unitary group 
U(N), called Fubini-Study measure. However, in some cases, one needs to 
consider ensembles of mixed quantum states and then the situation is much 
more complex. Firstly because, the probability distribution on the set of density 
matrices can be induced using various distance measures. Most commonly used 
measures are derived from Hilbert- Schmidt or Bures distance [2j. In this paper 
we restrict our attention to the former measure, i.e. Hilbert- Schmidt measure, 
which belongs to the wider class of probability measures induced by partial 
trace. 
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To obtain a sample form HS distribution we use the following procedure. 
First we take a square complex matrix A of size N, with real and imaginary 
part of each element being i.i.d. random variables with a standard normal distri- 
bution. Then, we calculate p = t ^ 4t . The above, by construction, is a density 
matrix, and moreover is distributed with HS measure 2J. 



5 Stability of probability distribution of the queue 
length 

The evolution of queuing system for each initial state po is performed by a 
mapping <£>, which is a composition of maps $c, <&k- Thus, queue state of 



i-th step is of the form (12). Composition the partial trace over subsystem Q 
and von Neumann measurement performed over subsystem Q gives probability 
distribution of the queue length. Denote by C a linear operation that traces out 
subsystems / and O and returns probability distribution given by performing 
measurement over subsystem Q i.e. 

C(p)=J2(i\teio(p)\i)- (15) 

i 

After t time steps the probability distribution of the queue length is given by 

p t = C&(p ). (16) 

In general, superoperator of quantum channel is not hermitian matrix, so its 
eigenvalues are in general complex numbers. Since quantum channel $ trans- 
forms convex compact set of density matrices into itself, thus there exists a fixed 
point called invariant state a, such that $a = a. This follows from Brouwer 
fixed point theorem. From above we have that superoperator $ has at least one 
eigenvalue equal to one, and it can be shown from the positivity property of the 
quantum channels, that all eigenvalues has magnitude less or equal than one [2J. 

Superoperator $ represents a quantum channel thus the spectrum {zi}fL 1 of 
$ belongs to the disk \zi\ < 1. Let us order eigenvalues of $ according to their 
absolute values \zi\ < \z 2 \ < ■ ■ ■ < \zn\. Distribution of queue length depends 
on the moduli of eigenvalues. We can distinguish following cases. 

In the first case, if Z\ equals to one and \zi\ < 1 for i from {2, 3, iV}, then 
the limit lim^oo $*(po) exists and is equal to invariant state a for any initial 
state p [4 . 

In the second case, if any \zj\ — 1 for j from {2, 3,...,iV} then the limit 
lim t _ i . 00 ^(po) might not exist. We are interested whether the probability dis- 
tribution of queue length is stable for the operator (7$*, so if there is a limit 
limt^oo p t . In order to analyse the existence of this limit we will use the notions 
of linear systems theory. 

Definition 1 (|_3j) (7$* is semistable if lim^oo pt exists for all initial condi- 
tions Pq. 

Proposition 1 The probability distribution of the queue length is semistable 
when limit lim t _ > . 00 (p t+1 — pt) exists and coincides to zero vector. 
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Since pt is a vector from the Hilbert space, hence with the completeness of the 
space follows that if there exists the limit lini4_ i . 00 p t then the limit lim^oo (p t +i — 
Pt) coincides to zero vector. 



Proposition 2 The probability distribution of the queue length is semistable 
when 

st||_n ( 17 ) 



lim ||C*$ t+1 - C*$ f || = 0. 

t— >oc 



Limit from Proposition [T] can be written as lim t _ i . 00 (C<I> t+1 — CQ t )po and coin- 
cides to zero vector for any initial state p when C<J?' is semistable. Thus if the 
system C$* is semistable then limit (17) coincides to zero. 



The convergence of (16) can be checked numerical for any C and $. Thus, 



it is possible to verify if a given model has a stationary probability distribution 
of the queue length. 

Example 1 Consider an example based on Hadamard coin. Lets fix register 
dimension of queue length Dq to 10, thus maximal length of queue can be 9 and 
lets set dimensions of registers used to evaluating flow of jobs into the system 
in single time step Di = 2 and jobs processed in single time step Do = 2. We 
assume that in the initial state the queue is half-filled so it has 5 jobs. 
We set the initial state of the system to 



Po° Q = \(\0) - i|l»«0| - ® |(]0> - i|l»«0| - i<l|) ® |5)(5|. 
The coins are unitary and are chosen to be Hadamard gates 



H = 



1 1 



1 



(18) 



(19) 



After 500 steps, the probability distribution of queue length becomes stabilized 
and order of magnitude of ||C<1' 500 — C$ 499 || is 10 -2 , as shown in the Fig. 




100 200 300 400 500 
t 



Figure 2: Stabilization of the probability distribution of the queue length After 
500 step, the probability distribution of the queue is stable. 

The state of the queue reaches lower and upper barriers. In each subsequent 
time step the likelihood of barriers increases and the remaining probabilities 
converge to zero. The probability distribution of the queue length depends on 
the initial state. The choice of half-filled state the queue determines the place of 
the middle peak of the likelihood, as shown in the Fig. [3| 
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Figure 3: The probability distribution of the queue length with Hadamard coins. 
Up to 5 step, evolution of the quantum queue behaves unitarily. Next, the 
probability of the queue lengths are distributed at the barriers. The middle 
peak is the result of choice of the initial state (18). 



6 Classical system as special case of quantum 
systems. 

In a particular case, formalism of discrete time quantum queues can be used to 
describe behaviour of a simple classical queueing system. Classical coin may be 
seen as a probability distribution over number of jobs flowing into the system and 
jobs processed. Quantum analogue of classical coin is a quantum channel that 
transforms any quantum state into diagonal state. The quantum description 
is of course in this case extremely inefficient due to large number of excessive 
parameters. 

In order to reduce a quantum queuing system to classical one each step of 
the evolution a new coin uncorrelated with the state of the queue has to be 
introduced. It can be done by setting <I>c to a composition of two channels: 
first one that traces out the coin systems I and O, second one that introduces 
a coin transforming any quantum state into diagonal quantum state. 

Transformation of quantum coin into a classic is performed by a quantum 
channel in form 

D,xD -l 

M*0 = \^){x\p\x){x\. (20) 

Thus classical queue is implemented using a coin of the form $d • Consider 
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superoperator corresponding with the channel $d given by 

Dr 2 xD 2 -l 



®d= \x){x\<g)\x){x\. (21) 

Any superoperator <i> corresponding with quantum channel from Af-dimensional 
space to L-dimensional can be presented as 

M L 

^=EE c ***.'i*)<ii®iooi. (22) 

i,j k,l 

where Ci,j,k,i € C are constants. In our case M = L = N . 

Composition of $£> and any superoperator $ is in the form 

N 

$n$= J2 c w(\x)(x\®\x)(x\)(\k)(i\®\l)(j\) (23) 
which is equivalent to 

JV 

$ D • $ = Ci,j,x,x\x){i\ ® \x){j\. (24) 
Jamiolkowski representation j2J of $£> • $ is given by the form 



J(4> D = Cij^alaXsl (8 (25) 

From the property TP of quantum channels shows that tri J(<&d • $) = 1 thus 

n / n \ 

triJ($ 23 .$)=5^(5^c i)J> , x ] |i>01=$>,j|*><il- (26) 
Submatrix determined by elements 



c i.i,x,x\i x= a (27) 



is stochastic [3]. Thus coin of the form $£> • $c simulates the classical queueing 
system. 

Example 2 Lei's se£ the queue length dimension Dq = 10, it means that max- 
imal length of queue can be 9 and let's fix dimensions of registers used to evalu- 
ating flow of jobs into the system in single time step Dj = 2 and jobs processed 
in single time step Do — 2. Initially, the probability distribution of the queue 
length is unimodal and has "symmetric Bell" shape. Next, the distribution begins 
to unify and after 49 steps, the probability distribution is close to the uniform 
distribution (Fig. 

In classical Queueing Theory length of the queues can have different prob- 
ability distribution, e.g. Poisson distribution, Erlang distribution. Quantum 
queues can also have various probability distribution of length depending on 
the stochastic matrix (27). 
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Figure 4: The probability distribution of the queue length with classical coin. 
At the beginning, the probability distribution of the queue length is unimodal. 
After 49 steps the probability distribution is close to the uniform distribution. 



7 The mean probability distribution of the queue 
length 

Consider queuing system performed by mapping <£> such that lim t _). 00 C^' is 
convergent, where C is the partial trace and von Neumann measurement per- 
formed over subsystem Q. The probability distribution of the queue length is 
stationary and depend on the initial state p. Using the Monte Carlo method it 
is possible to calculate the mean probability distribution of the queue length for 
every initial state p. Consider the set of random states f2 and a Hilbert-Schmidt 



measure p discussed in Subsection 4.2 then the mean probability distribution 
of the queue length over initial states from f2 is given by 



lim 

t— f CO 



C^(p)dp(p). 



(28) 



Example 3 Let the sizes of registers used to evaluating flow of jobs into system 
and jobs processed in single time step be Dj — 4, Do — 4, respectively. Let's fix 
the register dimension of queue length Dq to 10 in single time step and O as 
a set of mixed random states. Quantum random walks are simulated using the 
Walsh- Hadamard, Grover and DFT coins. More precisely, in each case QRW 
are simulated by coin operator given as 



$t,(p) = (U 1 ®[/% l Q )p(U I ®U°® t Q )\ 



(29) 



where U is a one of the above coin. For the 600 000 initial mixed random states 
obtained the following mean probability distributions of the queue length. 
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Case 1 In the first case, quantum random walks been implemented via a 
Walsh- Hadamrd coin H n = 771 (1 -i) 8 ™- fa this example n is equal to 2 and 
the mean probability distributions of the queue length is presented in Fig^ 

0.16 
0.12 
0.08 
0.04 
0.0 

0123456789 
#jobs 

Figure 5: The mean probability distribution of the queue length with Walsh- 
Hadamard coin. 




Case 2 In the second case, QRW are simulated using the Grover coin 



G = 



/I" 1 

2 2 



V 



1 \ 



l-v 



where in our case d — 4 and results are shown in Fig. [6| 
0.5 




2 3 4 5 6 7 
#jobs 



(30) 



Figure 6: The mean probability distribution of the queue length with Grover 
coin. Error bars indicate plus minus one standard deviation. 
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Case 3 In the third case, quantum random walks are realized by DFT-coin 



( 



D 



Vd 



1 1 

1 w 



\1 w 4 ' 1 



1 



2(d-l) 



,(d-i)(d-i) 



(31) 



where d = 4. For i/izs coin, the mean probability distributions of the queue length 
is shown in Fig. [7| 




1 2 3 4 5 6 7 
#jobs 



Figure 7: The mean probability distribution of the queue length with DFT coin. 
Error bars indicate plus minus one standard deviation. 



The coins selection affects the probability distribution of the queue length. 
For this coins the standard deviations are relatively low so that the mean prob- 
ability distribution of the queue length is a good estimator of queue length. 
While in case of Hadamard coin standard deviations are of the order of 10 -12 , 
thus initial states have little impact on queue length. 

8 Conclusions 

We have presented an extension of a simple queuing model based on Discrete 
Time Quantum Markov Chains using approch similar to Quantum Random 
Walks. We have shown that our model reduces to the classical one. We have 
proposed a methodology of analysis for quantum queuing models based on quan- 
tum channels and random mixed states. 

In cases we studied numerically we observed that quantum queues models 
behave in a fundamentally different way than classical models of classical queues. 
In quantum models the length of the queue tends to quickly reach the barriers 
and stay in them, while classical balanced models tend to steady state in form 
of flat distribution. 

The spectral structure of quantum models is much more complicated than 
that of classical ones. For most cases of queueing systems modelled using Dis- 
crete Time Markov Chain there exists steady state distribution. We have shown 
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that for our models of quantum queues steady state distribution might exits but 
is dependent on the initial state of the modelled system. Therefore we proposed 
to analyse such systems using random initial mixed quantum state. 
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